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(54) Transmitter-receiver of three-dimensional skeleton structure motions and method thereof 



(57) A transmitter-receiver of three-dimensional 
skeleton structure motions in which motion data of a 
skeleton structure in three-dimensional computer 
graphics (CG) is transmitted from a transmitting end to 
a receiving end and, based on the transmitted skeleton 
structure motion data, to create animation at the receiv- 
ing end, the transmitter-receiver comprises (1) transmit- 
ting means for deciding either of transmitting formats: 
(a) the motion data of the skeleton structure is added to 
an initial information and then transmitted as time series 
data; and (b) the motion data of the skeleton structure is 
disassembled into element data characterizing the 
motions in three-dimensional virtual space and then 
transmitted as data in which the disassembled element 
data is accompanied by connection methods thereto, 
and then transmitting the initial information to which the 
motion data of the skeleton structure is added based on 
the decided transmission format, as CG animation data, 
the initial information including hierarchy data for defin- 
ing hierarchical relationship of the skeleton structure, 
the initial state of the hierarchy data, constraint of the 
joints of skeletons, shape data to be attached to the 
skeletons, and data relative to the attachment to the 
skeleton structure; (2) transferring means for transfer- 
ring the CC animation data from the transmitting end 
computer to the receiving end computer, using a trans- 
mitting program on the transmitting end computer and a 
receiving program on the receiving end computer; and 
(3) receiving means in which the CG animation data 
from the transferring means is received, the transmitting 
format of the received CG animation data is discrimi- 
nated and, for the format (a), the initial information and 
the time series data is interpreted to decide the posture 
of the skeleton structure according to kinematics and, 



for the format (b), the initial information and the data in 
which the disassembled element data is accompanied 
by the connection methods thereto is interpreted to 
decide the posture of the skeleton structure according 
to kinematics. 
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Description 

FIELD OF THE INVENTION 

The present invention relates to transmitter- s 
receiver of three-dimensional skeleton structure 
motions and its method, which efficiently trans- 
mits/receives natural motions of a character having a 
complex skeleton structure, e.g., human beings, when 
producing or commercially utilizing three dimensional 10 
computer graphics (3DCG) based on network, e.g., 
internet 

BACKGROUND OF THE INVENTION 

75 

As a 3DCG application, virtual malls on internet, 
e.g., WWW (world wide web) and various homepages 
have been noticeable. Particularly, the rapid develop- 
ments of internet helps to improve the circumstances in 
which 3DCG of such as games and movies are readily 20 
handled at home. 

In a conventional WWW, a machine called "server," 
such as a personal computer (PC) and workstation, is 
connected, through internet, to a plurality of machines 
called "client," such as PC. In response to the demand 25 
of a client, as required, data including information on 
picture image, voice, text and layout provided by a 
server is downloaded, and then reconstructed at the cli- 
ent side to obtain necessary information. In such com- 
munication between servers and clients, there is utilized 30 
a communication procedure based on TCP/IP (trans- 
mission control protocol/internet protocol). 

Conventional data provided by servers were mainly 
text data and picture image data. Recently, the stand- 
ardization of VRML (virtual reality modeling language) 35 
and the browser of the VRML advanced, and the mod- 
ern trend is toward the transfer of 3DCG data itself, such 
as shapes and scenes. 

Brief description will be given of the VRML. To 
transfer picture data, particularly moving picture data 40 
using a conventional data format mainly for picture 
image and text, e.g., HMTL (hyper text markup lan- 
guage), requires much transfer time and costs. There- 
fore, network traffic restriction is imposed on the 
present-day system. In a conventional 3DCG, shape, 45 
viewpoint and lighting information were all processed by 
three-dimensional data. As computer graphics (CG) 
technology is advanced, the image quality of picture 
image created by CG is rapidly improved. In view of 
data quantity, it is more efficient to transfer CG data as so 
it is. In this case, data compression ratio is normally not 
less than 1/100 of the transfer of the equivalent picture 
image data: Therefore, the modern trend is toward the 
standardization of the transfer method of 3DCG data 
through network. As an attempt, the standardization of 55 
3DCG data called "VRML" has been proposed (VRML 
Ver. 2.0). The VRML Ver. 2.0 defines, for example, 
shape data called "primitive," data format of various 
lighting source data, viewpoint data and texture data, 
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and the designation process of rigid body motion. 

Among the conventional CG field, animation that 
produces picture image in real-time, i.e., so-called real 
animation, is worthy of remark. The reproduction of the 
real motion of CG characters utilizing a rSal animation, 
is being studied mainly in the field of CM (commercial 
message) and movies. There are for example a method 
called " kinematics method" in which a complex shape 
such as human being is represented by a skeleton 
structure (hierarchical structure), and its complex 
motion is reproduced naturally by the definitions of the 
motion quantity of the joints of skeletons that change 
from time to time. 

The aforementioned kinematics method was prima- 
rily developed in the field of robotics engineering. This 
method is to decide the posture of a skeleton model 
having a linear link structure comprising links and joints, 
by setting the angle of rotations in the directions of X, Y 
and 2 axes of the joint parts of the skeleton model, and 
the motion quantity (position) in the directions of X, Y 
and Z axes. 

By utilizing the kinematics method in a character of 
an arbitrary skeleton structure created by CG, it is being 
able to decrease the data quantity and reproduce natu- 
ral motions of such as human being and dinosaurs, 
compared to a conventional polygon based animation 
that is created by the simultaneous use of key frame 
method and the like. 

In 3DCG modeling language on a conventional 
internet in which VRML plays a central role, however, it 
is present condition that no consideration is given to 
methods for defining continuous time series motions of 
objects, and that there is no method for defining the 
motions of complex shapes of human being and the like, 
i.e., natural postures of hands and feet. 

In a conventional animation creation based on kin- 
ematics method, the creation of smooth motions 
requires much motion data. In terms of applications to 
network, traffic issue is left unsettled. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to realize that 
between clients and servers being connected on inter- 
net, complex shapes (avatar) of such as human being 
having a skeleton structure (hierarchical structure) and 
motion data serving as the base of the avatar are trans- 
mitted/received, and the avatar is then interactively 
operated with each other in three-dimensional virtual 
space on network 

Other objects and advantages of the present inven- 
tion will become apparent from the detailed description 
given hereinafter; it should be understood, however, 
that the detailed description and specific embodiment 
are given, by way of illustration only, since various 
changes and modifications within the scope of the 
invention will become apparent to the those skilled in 
the art from this detailed description. 

The present inventors have found out that the 
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above objects can be attained by the following facilities: 

(i) a mechanism for defining a complex structure of 
such as human being by a skeleton structure, com- 
pressing, restoring and transmitting/receiving the s 
reference position (hereinafter referred to as "root") 

of a specified skeleton and the motion information 
of each joint position of the skeleton; 

(ii) a mechanism for disassembling the motion data 

of the skeleton structure to be added to an initial 10 
information, which comprises the hierarchical rela- 
tionship of the skeleton structure, the initial state of 
the skeleton structure, constraint of the skeleton 
structure (e.g., the degree of freedom of each joint 
rotation and the rotation range), shape data to be 15 
attached to skeletons and data relative to the 
attachment to the skeleton structure, into the repre- 
sentative element data of the motions in three- 
dimensional virtual space (hereinafter referred to as 
"basic motion"), transmitting/restoring the disas- 20 
sembled basic motions together with methods for 
connecting the representative motions of the basic 
motions; 

(iii) a mechanism for deciding the postures of nec- 
essary skeleton structures based on the transmit- 25 
ted/received animation information; and 

(iv) a mechanism for interactively altering, for exam- 
ple, the operations of motions such as the direc- 
tions of motions and the stream of the basic 
motions, according to the instructions of users who 30 
operate based on the motions of avatars to be 
transmitted/received. 

In accordance with this finding, in transmit- 
ting/receiving three-dimensional motions of a character 35 
having a complex structure such as human being, it is 
possible to define a human hierarchy by a skeleton 
structure and then transmit/receive, in time series, the 
motion quantity of some joints of the defined skeleton 
structure in three-dimensional virtual space. It is also 40 
possible to add, into representative motion elements, 
connection methods thereto, and then transmit/receive 
it. These enable to transmit/receive natural and smooth 
motions of characters in transmission/receiving system 
based on network, thereby considerably reducing the 45 
data quantity during the transfer. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram showing a structure of a so 
transmitter/receiver of three<Jimensional skeleton 
structure motions according to an embodiment of the 
present invention. 

Figure 2 is a block diagram showing a structure of a 
CG animation data transmitting means. 55 

Figure 3 is a block diagram showing a structure of a 
CG animation data receiving means. 

Figure 4 is a diagram showing a hierarchical rela- 
tionships of human skeleton structure. 



032 A2 




Figure 5 is a diagram showing a data format of a 
skeleton structure. 

Figure 6 is a diagram for explaining a process for 
subdividing method of a skeleton structure motions. 

Figure 7 is a diagram for explaining sub-three- 
dimensional virtual spaces of divided motions. 

Figure 8 is a diagram for explaining how motion 
position is restored from the sub-three-dimensional vir- 
tual spaces of the divided motions. 

Figure 9 is a diagram for explaining a process for 
changing into a joint angle when given sub-three- 
dimensional virtual spaces. 

Figure 10(a) and 10(b) are diagrams showing a 
method for mapping human basic skeletons and face 
shape. 

Figures 1 1 (a) and 1 1 (b) are diagrams for explaining 
connections between basic motions. 

Figure 12 is a diagram of a stream for creating 
motion data from human motions. 

Figure 13 is a diagram of a script expression of 
motion data of a CG skeleton structure. 

Figure 14 is a diagram showing a process for trans- 
mitting/receiving motion data of a CG skeleton struc- 
ture. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

An embodiment of the present invention will be 
described referring to the accompanying figures. 

Referring to Figure 1, a transmitter/receiver of 
three-dimensional skeleton structure motions according 
to this embodiment is one in which from a transmitting 
end, motion data of a skeleton structure in 3DCG is 
transmitted to a receiving end, and animation is then 
created at the receiving end based on the transmitted 
motion data of the skeleton structure. The transmit- 
ter/receiver is provided with CG animation data trans- 
mitting means 1 , CG animation data transferring means 
2 and CG animation data receiving means 3. 

Referring to Figure 2, the CG animation data trans- 
mitting means 1 is provided with skeleton structure 
defining means 11, motion data defining means 12 and 
motion data element disassembling means 13. Depend- 
ing on requirements from a receiving end, the CG ani- 
mation data transmitting means 1 is to add motion data 
of a skeleton structure to an initial information and then 
transmit. Specifically, it is decided whether the motion 
data of a skeleton structure should be transmitted as 
time series data (hereinafter referred to as "transmis- 
sion format F), or the motion data of the skeleton struc- 
ture should be disassembled into basic motions which 
characterize the motions in three-dimensional virtual 
space, so that it is transmitted as data in which the dis- 
assembled basic motions is accompanied with the con- 
nection method thereto (hereinafter referred to as 
"transmission format IT). Based on the decided trans- 
mission format, the transmitting means 1 is to add the 
motion data of the skeleton structure to the initial infor- 
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mation, followed by its transmission. The initial informa- 
tion include hierarchical data for defining hierarchical 
relationships of the skeleton structure, the initial state of 
the hierarchy data, constraint of skeleton joints, shape 
data to be attached to the skeletons, data relative to the 5 
attachment to the skeleton structure, moving picture 
data stream that perform moving picture mapping of 
some of shape data, and mapping methods. 

Referring again to Figure 1 , the CG animation data 
transferring means 2 is to transfer CG animation data, in 10 
which motion data of a skeleton structure is added to an 
initial information, from the transmitting end computer to 
the receiving end computer by using a transferring pro- 
gram on the transmitting end and a receiving program 
on the receiving end. 15 

Referring to Figure 3, the CG animation data 
receiving means 3 is provided with skeleton structure 
defining means 31, shape data corresponding means 
32, motion data defining means 33, posture deciding 
means 34, motion element data connecting means 35 20 
and motion connecting means 36. The CG animation 
data receiving means 3 is to receive CG animation data 
transferred from the CG animation data transferring 
means 2; to distinguish the transmission format of the 
received CG animation data; to interpret an initial data 25 
and motion data of a skeleton structure which have 
been transmitted by the distinguished transmission for- 
mat; and to decide the posture of the skeleton structure 
according to kinematics. 

Specifically, when the transmission format is the 30 
transmission format I, the CG animation data receiving 
means 3 is to interpret the initial information and the 
motion data of the skeleton structure transmitted as 
time series data and then to decide the posture of the 
skeleton structure according to kinematics. On the other 35 
hand, when the transmission format is the transmission 
format n, the CG animation data receiving means 3 is to 
interpret thejnitial information, and the motion data of 
the skeleton structure in which the connection process 
to the disassembled basic motion has been added to 40 
the disassembled basic motion, and then to decide the 
posture of the skeleton structure according to kinemat- 
ics. 

Description will be given of the operation of the 
transmitter/receiver of three-dimensional skeleton 45 
structure motions. 

The CG animation data transmitting means 1 
decides, depending on requirements from the receiving 
end, as to whether it should be transmitted by the trans- 
mission format I or n and, based on the decided trans- so 
mission format, adds the motion data of the skeleton 
structure to the initial information, followed by transmis- 
sion. 

At this time, the skeleton structure defining means 
1 1 defines, by a skeleton structure, a CG character as a 55 
transmission object having complex skeleton, e.g. 
human being, and then sets a root (reference position of 
calculation) to the top level parent position of the hierar- 
chical structure of the defined skeleton structure. At this 




stage, for instance, human being has the skeleton struc- 
ture as shown in Figures 4 and 10(a). Its root is normally 
set in the center of gravity of the body, e.g. groins of feet, 
and the origin of a local coordinate system of a CG 
character (hereinafter referred to as "right-handed sys- 
tem of Z top) is placed there. 

In Figure 4, parts surrounded by square are joints 
of a skeleton structure. Lines linking the joints corre- 
spond to portions of arms or feet, which are called "link" 
or "segment". Parts surrounded by ellipse are tip por- 
tions of hands or feet, which are called "end site." Figure 
4 shows a basic skeleton. As required, the hierarchy of 
a skeleton structure is altered. For instance, when it is 
required to express in more detail the hierarchy of 
hands of the skeleton structure shown in Figure 4, the 
hierarchies of fingers and thumb, and the joints con- 
tained in the hierarchies may be provided under wrists. 

In addition to the hierarchical relationship of the 
aforementioned joints, the hierarchical initial states are 
set to the skeleton structure. For instance, there are set 
initial directions of the lengths of arms and legs. Further, 
the moving ranges of the joints are set to the skeleton 
structure. For instance, it is set that the right elbow is 
rotatable from a certain degrees to a certain degrees in 
the rotations X, Y and Z axes of the local coordinate 
system, respectively. 

Referring to Figure 5(a), for human elbows, seg- 
ments correspond to upper arms or forearms, parts 
called "site" are present at both ends of the segment. 
For instance, the joints of the elbows are further defined 
as an upper arm site and a forearm site. 

Referring to Figure 5(b), in the definition of a skele- 
ton structure, each part name, e.g. "Neck and Neck- 
Base," is added to segments, sites and joints, as an 
identifier. Three components of three-dimensional coor- 
dinate position "-p" or the angle of rotation "-r" are set to 
a site. In the coordinate of a site, the origin of a local 
coordinate is placed at the parent site of each segment. 
As to the joints, there are set identifiers such as "Skull- 
Base" and hierarchical relationship, i.e., parentage "-c", 
which indicates that a certain parent site connects to a 
certain child site. Further, a moving range "-I" (angle) 
and the degrees of freedom of rotation (e.g. for "Ball," 
rotations around X, Y and Z axes). 

The motion data defining means 12 sets the motion 
data of main parts of the skeleton structure set by the 
skeleton structure defining means 11. The aforemen- 
tioned main parts signify the skeleton parts required to 
move. For instance, when it is required to move the 
whole body, three-dimensional coordinate position or 
rotation data of the joints of the skeletons contained in 
the whole body, are given as time series data. The 
motion data format normally comprise time data such 
as frame numbers, and entity data. The time data and 
the entity jdata are respectively composed of the name 
of joints, identifiers for distinguishing rotation data or 
position data, and three elements (compositions of X, Y 
and Z axes). 

The motion element data disassembling means 13 
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disassembles, as required, motion element data into 
reference points, motion passage information required 
for expressing the skeleton movement, based on the 
motion data stream of time series. The disassembling 
method will be described later. 

The CG animation data transferring means 2 trans- 
fers CG animation data in which an initial information is 
accompanied by motion data of a skeleton structure, 
from the transmitting end computer to the receiving end 
computer by using a transmitting program on the trans- 
mitting end computer and a receiving program on the 
receiving end computer. Specifically, according to 
TCP/IP, the skeleton structure and the motion data com- 
pressed by the CG animation data transmitting means 1 
are transferred between servers and clients. 

The CG animation data receiving means 3 receives 
CG animation data transferred from the CG animation 
data transferring means 2, distinguishes the transmit- 
ting format of the received CG animation data. For the 
transmitting format I, the means 3 interprets the initial 
information and the motion data of the skeleton struc- 
ture being transmitted as time series data, to decide the 
posture of the skeleton structure according to kinemat- 
ics. For the transmission format n, the means 3 inter- 
prets the initial information and the motion data of the 
skeleton structure in which the connection method of 
the disassembled basic motions has been added to the 
disassembled basic motion, to decide the posture of the 
skeleton structure according to kinematics. 

At that time, the skeleton structure defining means 
31 receives the human skeleton structure data to be 
defined by the skeleton structure defining means 11, 
and then interprets the received skeleton structure data. 

The shape data corresponding means 32 associ- 
ates a certain segment of a skeleton structure as a 
processing object processed, with a certain part of 
shape data previously transferred. This shape data sig- 
nify data relative to skin parts to be attached to the skel- 
etons of a CG character. Normally, the shape data is a 
polygon stream or a set of mesh data. The polygon 
stream or the mesh data is classified into, for example, 
a group corresponding to upper arms and a group cor- 
responding to legs. It is previously defined how the clas- 
sified data group corresponds to the upper arms or legs 
of the skeleton structure. Normally, the correspondence 
between shapes and skeletons is decided by position- 
ing, at the parent site of the segment of the skeleton 
structure, the origin of a local coordinate system of the 
segment, and setting how much skin should be 
attached in which direction from the origin. The direction 
is designated by positioning vector and orientation vec- 
tor. The segment of a skeleton is positioned in the 
center of gravity of a plurality of shape groups and 
attached to the minimum distance from each shape 
group. 

In order to show shapes naturally, it is necessary to 
set such that skin does not break at joint parts. This is 
realized by setting a new shape group called "flexor" for 
the shape groups of the joint parts, setting, by weighting 



032 A2 




factor, the influences according to the bending angles 
from a parent segment and a child segment depending 
on the bending angles of the joint parts, to deform the 
shape groups contained in the flexor. 
5 The motion data defining means 33 receives 

motion data transmitted from the motion data defining 
means 12 or the motion element data disassembling 
means 13 and then restores the received motion data 
as necessary. 

10 The motion element data connecting means 35 
connects smoothly basic motions of the motion data 
restored in the motion data defining means 33, with 
each other. 

The posture deciding means 34 decides the pos- 

15 tures of skeletons at an arbitrary time, using the skele- 
ton structure data from the skeleton structure defining 
means 31, the shape data grouped by skeleton data 
from the shape data corresponding means 32, and the 
motion data from the motion data defining means 33. 

20 Further, the posture deciding means 34 adds, as neces- 
sary, the motion data in which the basic motions trans- 
mitted from the motion element data connecting means 
35 have smoothly been connected with each other, to 
decide the postures of the skeletons at an arbitrary time. 

25 The motion connecting means 36 connects the 
postures of the skeletons decided in the posture decid- 
ing means 34. 

Description will be given of a method for deciding 
the posture of a skeleton structure. 

30 When deciding the posture of a skeleton structure 
shown in Figure 4 at an arbitrary time (frame), although 
it depends on motion data format, there is basically 
employed kinematics method that was primarily devel- 
oped in the f ield of robotics engineering(see, for exam- 

35 pie, Robot Dynamics and Control written by Arimoto, 
published by Asakura-shoten). 

In the kinematics method, time variation quantity of 
the angle data of each joint is given to an initial position 
of a joint structure connected by linear chain links to 

40 decide joint positions of parents and then those of chil- 
dren, thereby deciding the postures of the linear chains. 

In the case of a human skeleton as shown in Figure 
4, it is normally necessary to individually decide the 
respective postures of five linear chains which com- 

45 prises the right and left feet tips from the root, the right 
and left hand tips from the root, and the head top from 
the root (e.g., the right arm and the right leg). 
Suppose that data from the motion data defining means 
33 is the angle data of the respective joints. Generally, 

so since necessary angle data of the joints in Figure 4 are 
all given to the posture deciding means 34, the positions 
of the respective linear chains are decided uniquely. As 
discussed above, a method for deciding the positions of 
skeletons by using an initial state of a skeleton structure 

55 and aggie data of joints at an arbitrary time, i.e., rotation 
angle from an initial position in the local coordinate sys- 
tem, is called "forward kinematics method." 

In the forward kinematics method, the posture 
deciding means 34 performs calculations of the initial 
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value data of skeletons input from the skeleton structure 
defining means 31, in the order of increasing distance 
from the root For instance, to parent sites of the skele- 
tons and the lengths of segments shown in Figure 5, a 
rotation matrix (3*4 matrix), which depends on the rota- 5 
tion angles of parent sites given by the motion data 
defining means 33, is acted to decide the positions of 
child sites. The operation for making the rotation matrix 
act to the aforesaid parent sites and the lengths of the 
segments is repeated as many as the number of joints, w 

As a posture deciding method other than the for- 
ward kinematics method, there is inverse kinematics 
method. In the inverse kinematics method, it is neces- 
sary to set a range of calculating in a skeleton structure, 
i.e., the range of the effect of skeleton movements, 15 
which is called "handle." In Figure 4, a handle is set, for 
example, from the right nape to the right hand tip. To this 
handle, time series data of the position of the tip of the 
handle (the right hand tip in this example) in three- 
dimensional virtual space is given. Although the posi- 20 
tion data can be set by the maximum six elements of 
three-dimensional coordinates (X, Y and Z axes compo- 
sitions) and rotational angles (rotational compositions 
around X, Y and Z axes) of the tip, normally, either of the 
three compositions are separately given to the posture 25 
deciding means 34. 

When the posture of a skeleton (the range of a 
hand) is solved from the position of the tip of the handle 
by employing the inverse kinematics method, but for 
constraint, plural solutions could be present. That is, the 30 
postures of the skeletons in three-dimensional virtual 
space cannot be decided uniquely. Therefore, it is nor- 
mally calculated based on an evaluation function 
(energy minimization) by which the sum of the square of 
microscopic change quantities of all joint angles con- 35 
tained in a handle becomes a minimum. Specifically, 
calculated are joint angles employed in the forward kin- 
ematics method and an inverse matrix of a determinant 
expressing the relationship of tip position, which is 
called "Jacobi matrix" and is decided uniquely. In the 40 
inverse matrix, when the number of joints is N, it 
becomes a matrix of 6*N, wherein 6 denotes the maxi- 
mum degree of freedom. Since no inverse matrix exists 
as it is, pseudo Jacobi inverse matrix is calculated by 
such as sweep method under the aforementioned con- 45 
straint (see Robotics written by Hirose, published by 
Shokabo). 

In the posture deciding means 34, either the 
inverse kinematics or the forward kinematics is used 
depending on the use, and, as required, the joint angle so 
decided by kinematics is compared with a set moving 
range based on the moving range data of an arbitrary 
joint to be-input from the skeleton structure defining 
means 31, thereby placing restrictions on the postures 
of joints. After calculating the posture by kinematics, 55 
when a certain joint angle exceeds the moving range, 
there is added conditional judgment processing to be 
set to the value obtained by the posture calculation. 

Thus, the posture of a character having a skeleton 



structure can be decided by employing the aforemen- 
tioned kinematics method. 

Description will be given of a method for affixing 
skin to postures of skeletons. 

As previously described, in 3DCG, skin data is a 
polygon group or a free-form surface group. Normally, 
the modeling of skin shape requires a general 3DCG 
modeling tool. The output data format of this tool utilizes 
the standard formats, such as Dxf (the file format of the 
trade name Auto "CAD", manufactured by AUTODESK 
Corp.) and Obj (the file format of the trade name "wave- 
front", manufactured by Silicon Graphics In.). 

In the shape data corresponding means 32, a poly- 
gon group is associated to a certain segment of a skel- 
eton structure defined in the skeleton structure defining 
means 31. For instance, when the shape group of 
human upper arms corresponds to the segment of 
upper arms in skeletons, the origin (e.g., the position of 
center of gravity) of a modeling coordinate of the shape 
group is matched with the origin of a parent site coordi- 
nate of the segment, and then the fine adjustment of 
location relationship js performed using offset from the 
matched point (three compositions in the directions of 
X, Y and Z axes) and the scale of the shape (enlarge- 
ment ratio in the directions of X, Y and Z axes). 

By deciding the postures of the skeletons using kin- 
ematics method, the position and direction of a parent 
site of a target segment are decided. Therefore, by 
allowing the moving rotation matrix as described above 
to directly act on shape data of the group corresponding 
to each segment (top coordinate of the polygon), skin 
moves in association with the motions of skeletons. 

In the above described manner, the animation of a 
CG character having a basic skeleton structure is cre- 
ated. 

In the foregoing example, the motion data is angle 
data of joints in the forward kinematics or position data 
of a tip portion in the inverse kinematics. Further, time 
series data of the angle data of the joints and the posi- 
tion data of the tip portion are required to subsequently 
input from the motion data defining means 33. 

Generally, in a transmitting/receiving system of the 
CG animation data that is connected to internet, as 
shown in Figure 1 , it is necessary to minimize communi- 
cation traffic in the CG animation data transferring 
means 1. 

Description will be given of a compression method 
of motion data. 

It is necessary that compression rate can be con- 
trolled hierarchically according to plot capability of 
transmitting/receiving end machines. 

Referring to Figure 6, CG character motion data is 
decided by information (i) the motions of joints of a skel- 
eton structure; and (ii) the positions of the entire body in 
three-dimensional virtual space, and direction data. 
Hereinafter, the former will be called "local information" 
and the latter will be called "world information." 

In normal CG character animations, the world infor- 
mation is defined as root information of the skeleton 
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structure shown in Figure 4, and the local information is 
defined as joint information. 

Firstly, a three-dimensional virtual space surrounding a 
moving range of a CG character as shown in Figure 6, 
is estimated. The reference coordinate of the three- 5 
dimensional virtual space is matched with the root posi- 
tion of the skeleton structure (the position of a human 
spin base in Figure 6), and then the origin of a local 
coordinate system is set. With respect to the origin of 
the local coordinate system, a virtual action space in the w 
directions of X, Y and Z axes is set. The whole size of 
the virtual action space is decided by setting the dimen- 
sions in the directions of X, Y and Z axes. The move of 
the virtual action space in the world coordinate system 
in association with the move of the body can be defined 75 
by the translating trace and rotational matrix of the char- 
acter. The virtual action range will be rotated or 
removed according to the move of the CG character, 
i.e., world information. Qualitatively, the virtual action 
range is the maximum range in which the hands and 20 
legs of a CG character can move in the local coordinate 
system. Although a rectangular parallelepiped is exem- 
plified as a virtual action space in Figure 6, a sphere 
centered with respect to a CG character may be 
selected. In this case, it is preferable that a division as 2 s 
described later is given in a polar coordinate system. 

Secondly, sub-three-dimensional virtual spaces 
that divide the three-dimensional virtual space are esti- 
mated. The sub-three-dimensional virtual spaces are 
for uniformly subdividing the virtual action space, and its 30 
size decides the number of quantizations by dividing 
pitches of dx, dy and dz in the directions of X, Y and Z 
axes in the local coordinate system, or the number of 
division (I, m, n) in the direction of X, Y and Z axes. 

In setting the motion of a CG character in three- 35 
dimensional virtual space, it is required to set joint posi- 
tions or the position of a tip position of a skeleton struc- 
ture. The position is defined by an identification number 
or a coordinate position of a sub-three-dimensional vir- 
tual space. By setting the dividing pitch of the sub-three- 40 
dimensional space greater, the quantization level of 
each joint position or a tip position of a skeleton struc- 
ture will be lowered, resulting in reduced data quantity. 

The sub-three-dimensional space is further divided 
hierarchically and then synthesized depending on hard- 45 
ware of the transmitting/receiving ends or the perform- 
ance of a transferring system, as shown in Figure 7. 
To code a continuous motion position of a CG character 
in a three-dimensional virtual space, the control points 
of the motion in three-dimensional virtual space shown so 
in Figure 8 are designated by a sub-three-dimensional 
virtual space. Requite information for reproducing 
motion include the position (or identification number) of 
a sub-three-dimensional virtual space at a starting point 
of the motion, the position (or identification number) of a 55 
sub-three-dimensional virtual space at the end point, 
and information of interpolation method, e.g., linear 
interpolation and spline interpolation, between the start- 
ing and end points of the motion. As increasing the 



information of the control points shown in Figure 8, the 
motion is reproduced smoothly, which, however, 
increases the data quantity. When the identification 
number is given, the conversion into, a coordinate in 
three-dimensional virtual space at thereceiving end , is 
performed by using, for example, the position of gravita- 
tional center of a sub-three-dimension virtual space and 
the relative position from the origin of a local coordinate. 
In this case, there occurs a quantizing error of the size 
of one sub-three-dimensional virtual space. 

The flow of the aforementioned data in the transmit- 
ting/receiving system of the skeleton data of the CG 
character shown in Figure 1 will be summarized. Firstly, 
in the motion element data disassembling means 13, 
the position and the moving rotation matrix expressing 
the direction (world information) in the world coordinate 
system in three-dimensional virtual space, the size of a 
virtual action space as shown in Figure 6, and the divid- 
ing pitches (dx, dy, dz) into sub-three-dimensional vir- 
tual spaces are transferred to a target CG character. 
Then, the positions or the identification number of sub- 
three-dimensional virtual spaces at starting and end 
points of three-dimensional position in which the skele- 
tons of arms and legs move, the sub-space position of 
the control points or the control point information, and a 
method of connecting the starting and end points of the 
three-dimensional position are transferred as motion 
data, by the unit of an arm and a leg of a CG character, 
as required. In the motion data element connecting 
means 35 at the receiving end, the transferred data is 
interpreted (restored), and the three-dimensional posi- 
tion of the CG character shown in Figure 6 is then inter- 
polated to reproduce the motion of the CG character. 

For simplification, the above description is provided 
on a method in which only the position of the tip portion 
is set. Likewise, when a posture is decided utilizing the 
forward kinematics in the posture deciding means 34, 
angle information obtained from the control positions of 
all the joints of necessary skeletons may be transferred 
as information of sub-three-dimensional virtual spaces. 

Figure 9 shows a method for obtaining joint angle 
data at the transmitting or receiving end when sub- 
three-dimensional virtual spaces are given to the pos- 
ture deciding means 34. 

Referring to Figure 9, an initial position of a joint 
position (the center position of a sphere in Figure 9) is 
set in the skeleton structure defining means 1 1 and the 
skeleton structure defining means 31. When a position 
of a sub-three-dimensional space at a certain time, or 
an identification number is given to the posture defining 
means 34, the gravitational position coordinate of the 
sub-three-dimensional space can be calculated. Based 
on the position in the sub-three-dimensional virtual 
space or an identification number, the dimension of a 
sub-three-dimensional a virtual space, and the length of 
a segment that has been known, the rotational angles 
(ex, Oy, 0z) around the respective axes in the local coor- 
dinate system are calculated. In this case, the order of 
the rotations (e.g., X-Y-Z) should be previously decided. 
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When a posture is decided utilizing the inverse kin- 
ematics in the posture deciding means 34, in the CG 
animation data transmitting means 1, handle informa- 
tion of a skeleton structure and the position information 
of the tip position of skeletons are transferred from the 5 
motion element data disassembling means 13. 

In the foregoing description, information on distor- 
tions of skeletons, i.e., the rotations around Z axis in the 
local coordinate system, is not defined exactly. In a case 
where the degree of freedom of a joint is "Ball" in the 10 
definition of joints, i.e., joint information in Figure 5(b), 
even when it is rotatable in three axes of X, Y and Z t the 
rotation around Z axis is disregarded if distortion is 
restricted. In human being and the like, however, distor- 
tions of joints of such as hip, neck and wrists signifi- 15 
cantly affect the posture. Particularly in a CG character, 
it is necessary to precisely express as to whether wrists 
are turned up. In this case, distortion information, i.e., 
the rotation angle around Z axis, should be added to the 
sub-three-dimensional virtual space information, the 20 
resulting information is then transmitted/received. For 
instance, in the illustration in Figure 11(a), distortion 
angle 0 0 of a wrist at time to and distortion angle 0 1 at 
time t-i are transmitted/received and, among joint angles 
of skeletons decided in the posture deciding means 34, 25 
only portions requiring distortion are replaced with 
angle data subjected to the interpolation between 0 0 
and e t . 

Description will be given of a method for connecting 
basic motions (e.g., a continuous motion such as "to 30 
raise the right hand", and "to wave a hand") with each 
other. As basic motions of a CG character, the following 
two examples will be illustrated: (A) motion in which the 
right hand passes from a virtual action space at the 
below left of the body to a virtual action space in the 35 
center of the body, and then moves to a virtual action 
space at the upper right; and (B) motion in which a hand 
moves from a virtual action space at the upper right to a 
vertical action space in the front of the body. 

Figure 1 1 (a) is a diagram for explaining a connec- 40 
tion of two basic motions. 

Referring to Figure 11(a), it is provided that the 
motion from time to to t1 corresponds to the motion (A), 
and the motion from time t2 to t3 corresponds to the 
motion (B). The motion element data disassembling as 
means 12 disassembles the motion into virtual action 
space information and then transfers sub-three-dimen- 
sional virtual space information of the starting and end 
points, and, as required, sub-three-dimensional virtual 
space information of control points between the starting so 
and end points, together with the interpolation method. 
In the CG animation data receiving means 3, the motion 
element connecting means 35 interprets the sub-three- 
dimensional virtual spaces to restore the position infor- 
mation of each basic action. Further in the motion ele- 55 
ment connecting means 35, the basic actions (A) and 
(B) are connected with each other. 

Figure 11(b) shows a state in which the normal 
basic actions are connected with each other on the 




basis of time region. 

Referring to Figure 1 1(b), the end point position of 
the basic action (A) can be restored from the action 
space information at time t1. The graph of Figure 1 1(b) 
shows a case where the restored basic actions are con- 
verted into the position of the end site of the right hand 
joint (the tip of the right hand) or joint angle data. Simi- 
larly, the angle of the right hand tip or the coordinate 
value at time t2 can be restored from the action space 
position at time t2. As connection information for con- 
necting these basic actions, it is necessary to set infor- 
mation on how much it goes in the negative time 
direction of the basic action (A) (a value in the negative 
time direction, e.g., \'\ r ) and information on how much it 
goes in the positive time direction of the basic action (B) 
(a value in the positive time direction, e.g., t2*). Such a 
set value may have a fixed value as default at the trans- 
mitting/receiving end. Based on these information, inter- 
polation processing is performed using the coordinate 
values of the right hand tip at times t1\ t1, t2 and t2* 
shown in Figure 1 1(b). Although values indicated by cir- 
cles in Figure 11(b) generally have three compositions 
of X, Y and Z axes, one composition alone is illustrated 
here for the sake of simplification. 

As a method for interpolating these points, informa- 
tion on such as linear interpolation or spline interpola- 
tion is preset at transmitting/receiving ends. For a more 
smooth connection, sub-three-dimensional virtual 
space information serving as interpolation information is 
transferred between times t1 and t2 (see a point 
between times t1 and t2 in Figure 1 1(b). 

The above illustration refers to a case in which the 
posture of skeletons are decided in the posture deciding 
means 34 utilizing the inverse kinematics method. In a 
case utilizing the forward kinematics, each joint informa- 
tion is given to the posture deciding means 34. but the 
connection of the basic actions is performed on the 
same principle as the inverse kinematics method. 

Utilizing the aforesaid methods, by connecting a 
plurality of basic actions with one another based on a 
plurality of basic actions transferred previously and 
merely transmitting a new virtual action space informa- 
tion and the interpolation information, a new action 
whose basic action has been changed can be created 
with considerably less data quantity. 

Description will be given of a method for creating 
control points information that serve as staring and end 
points or a key of the aforementioned basic action. 

The basic action of a CG character in a three- 
dimensional virtual space is classified, as discussed 
above, into the world information, i.e., in which part of 
three-dimensional virtual space and along which posi- 
tion a target CG character moves; and the local informa- 
tion, i.e., which posture (position) the hands and legs of 
a target CG character takes at a certain time on the 
position of the CG character. The former is defined by 
translation quantities (Xtrans, Ytrans, Ztrans) of the root 
of the skeleton structure shown in Figure 4 at an arbi- 
trary time and the orientations (Xrot. Yrot, Zrot). The lat- 
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ter is defined by the rotations (Xrot, Yrot, Zrot) of each 
joint or the tip portion, or three-dimensional coordinates 
(Xtrans, Ytrans, Ztrans). These information are sent 
from the transmitting system to the receiving system as 
time series data or the aforementioned virtual action 
space information. 

In setting the basic action itself, normally used is 
technique called "motion capture." A method for creat- 
ing action data utilizing the motion capture will be dis- 
cussed. 

In the motion capture technique, the picture of a 
model whose joints are equipped with a marker reflect- 
ing light is taken by a plurality of cameras while being 
subjected to a desired motion. Based on the secondary 
picture image of the marker taken by two or more cam- 
eras, the three-dimensional coordinates of the marker 
or the angle data obtained by associating the skeleton 
structure is calculated (see for example Japanese Pat- 
ent Application No. 7-312005(1995)). The motion of a 
CG character subjected to the motion capture is 
obtained as angle data (time series) of joints of the skel- 
eton structure shown in Figure 4. Such data correspond 
to the position 1 of the movement from time to to t1 , or 
the position 2 of the movement from time t2 to t3. 

It is a basic method for transmitting/receiving 
motion data that the angle data of each joint of the skel- 
eton structure is sent, as a basic action, transmitted 
from the motion data defining means 12 to the CG ani- 
mation data transferring means 2 as time series data, to 
be interpreted in the motion data defining means 33. 

In the case where the motion data quantity is 
desired to be reduced, there is a method in which the 
control points information on a position is sampled and 
then the sampled information is transmitted/received 
together with its connection method. 

In the case where the transmitting/receiving data is 
required to be reused, the data should be disassembled 
into a virtual action space data shown in Figure 6. In this 
case, based on the position data subjected to the 
motion capture, the motion element data disassembling 
means 1 3 quantizes (vector quantization) into the virtual 
action space of the CG character in Figure 6, and then 
disassembles into the virtual action space data posi- 
tions and identification number. The motion element 
data connecting means 35 restores, from the received 
virtual action space data, the motion position subjected 
to the motion capture by utilizing the connection method 
information. 

Brief description will be given of a method for creat- 
ing motion data without using the motion capture and 
the like. 

The skeleton structure of the CG character in Fig- 
ure 6 and a virtual action space are set. An initial state 
of the CG character is as shown in Figures 10(a) and 
10(b). The virtual action space is divide into sub-three- 
dimensional virtual spaces and the obtained sub-three- 
dimensional virtual spaces are then designated by iden- 
tification number and the like. 

Referring to Figure 12 illustrating a simple setting of 



the right hand posture, the starting position of the right 
hand tip is decided. For instance, when the staring point 
is the right forward of the face, the number of a sub- 
three-dimensional virtual space in the. neighborhood of 

5 the right forward of the face is set (STEP 1). The result 
is displayed by deciding the posture of the right hand uti- 
lizing such as the inverse kinematics method. In this 
case, kinematic and display system are required as a 
simple browser. When the position of the right hand 

10 does not agree with the desired position, the step 
number of a sub-three-dimensional virtual space of the 
direction of X, Y and Z axes that are required to be 
removed, i.e., the local coordinate system, from the 
present block number or position, thereby setting a new 

/5 sub-three-dimensional virtual space (STEP 2). By 
repeating STEP 2, the desired position can be set. The 
advantage of this designation method is that a rough 
position can be set in a manner in which a person 
arranges the action, such as "a little right" and "a little 

20 rear." Such a designation is set with respect to the sub- 
three-dimensional virtual space of necessary starting 
position, end position and the control points (STEP n, 
STEP n+1, ...). 

The forgoing description was primarily given of the 

25 setting of skeleton motions. Actual requirement as a CG 
character is skin information bound to the aforemen- 
tioned posture of the skeletons. As previously dis- 
cussed, the segments of skin shape and skeletons can 
be assigned by sharing the local coordinate positions. In 

30 the kinematics method, it is necessary for a skeleton to 
be set to a portion that is required to move. Normally 
used hierarchy relations of skeletons is shown in Figure 
4 or Figure 10. In the cases where the shape of human 
finger tips are desired to be set, e.g., an opened hand 

35 and a bent finger, the skeleton of the fingers may be 
defined in the same manner. However, a mere definition 
of the skeletons of the fingers will increase data quan- 
tity. 

As a method for reducing the data quantity, one in 

40 which the shape of a hand is fixed and a desired shape 
data is replaced as required, will be discussed. 
Firstly, as shape data to be bound to the joints of the 
right and left hands of the skeleton structure in Figure 4, 
shapes in which the hand is for example opened or 

45 grasped are previously prepared. As shown in Figure 
11(b), when the motion of the right hand is given, the 
motion element data disassembling means 13 adds 
information on distortion and the kind of the shape data 
to be bound to the wrist and then transfers that informa- 

50 tion together with the sub-three-dimensional virtual 
space information. The motion element data connecting 
means 35 restores the position of the motion using the 
sub-three-dimensional virtual space information and, at 
the same time, judges the distortion of the wrist and the 

55 shapes to be bound to the wrist. Base on the judgment, 
the display of the results are switched, enabling to pre- 
cisely reproduce the shape of the hand tip. 

Description will be given of a method for represent- 
ing expressions that is significant in reproducing a CG 
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character. 

For a real representation of expressions, it is possi- 
ble to bind a head shape to the joint that corresponds to 
the neck of the hierarchy shown in Figure 4, but it is dif- 
ficult to reproduce the expressions of such as "being s 
laughing" "being angry." Therefore, expressions is 
treated by a method for mapping a real moving picture 
to a face shape. 

Referring to Figures 10(a) and 10(b), when per- 
forming mapping, the shape of a head is typically io 
sphere or cylinder and, as required, shape data repro- 
ducing the irregularity of a face is employed. To this 
shape data, the mapping coordinate or the mapping 
method in which the projection is taken into considera- 
tion is set. Further, taking into consideration the cases is 
where the neck will rotate in the directions of right, left 
and the like, there are prepared moving picture streams, 
i.e., MPEG2 (Motion Picture Experts Group phase 2) 
being compressed image, of expressions when a 
human face is viewed from a plurality of camera posi- 20 
tions, which is normally along a circle surrounding the 
face. When the direction of the neck is decided, it is 
determined from which moving picture stream the map- 
ping data (which depend on the viewpoint) of the 
expressions is selected and, as required, from plural 25 
moving picture streams, the corresponding pixels of 
image data of corresponding time based on a plurality of 
motion picture stream are weighed from an angle of 
view point. For instance, the viewpoint observing a CG 
character is present between the points A and B shown 30 
in Figure 10(b), A and B are selected as moving picture 
stream data, to decide the weight, which is proportional 
to the difference, depending on the gap in angles when 
the center of gravity of the character is viewed from the 
viewpoints of A, B and a viewpoint. 35 

The CG animation data transmitting means 1 calls 
for a mechanism for transferring moving picture streams 
of expressions compressed by for example MPEG2, 
and camera positions. The CG animation data receiving 
means 2 calls for a mechanism in which the com- 40 
pressed moving picture streams thus transferred is 
restored and then judged to which viewpoint an image 
belongs, depending on the camera positions, followed 
by mapping. For further details of the method for map- 
ping moving pictures, see Foley & Van Dam et a/., Com- 45 
puter Graphics Principles and Practice II, Addison 
Wesley. 

Figure 13 illustrates an example of script notation of 
motion with respect to three handles of the right hand, 
the left hand and the head. 50 

Referring to Figure 13, the numbers of sub-three- 
dimensional virtual spaces of starting, end and control 
points are set as position information, and a real repro- 
ducing time is transferred as addition information. In this 
example, spline is designated as interpolation method. 55 

Figure 14 illustrates an example of a method for 
transmitting/receiving motion data of a CG skeleton 
structure. 

Referring to Figure 14, the transmitting/receiving of 



the substance of the motion data represented in a sub- 
three-dimensional virtual space and the description lan- 
guage of the motion as shown in Figure 13, between the 
CG animation data transmitting means 1 and the CG 
animation data transferring means 2, realizes the trans- 
mitting/receiving of CG animation data without depend- 
ing on hardware, e.g., various calculations, 
performances of such as rendering, and OS (operating 
system). 

Brief description will be given of a method for per- 
forming collision check between two CG characters 
when a plurality of CG characters exist. 

As shown in Figure 6, one of the advantages of rep- 
resenting motion in a sub-three-dimensional virtual 
space is to simplify the calculation of the collision check. 
For instance, when it is roughly checked whether one 
arm of a character collides one arm of the other charac- 
ter, firstly, the boundary of segments contained in a tar- 
get arm of either character is estimated. Suppose that 
the boundary is a rectangular paralletopiped that is 
decided by parent and child sites of the arm of the skel- 
eton structure shown in Figure 4. The base area of the 
rectangular parallelepiped is decided by the size of skin. 
That of human being is normally a fixed value according 
to physique. To check the collision between the bound- 
ary and the sub-three<limensional virtual space (rec- 
tangular paralletopiped) of the other character, enables 
a simple and rough check. When required a further 
detailed check, the collision check of shape data con- 
tained in the above boundary (all the tops of polygon 
groups) may be performed. The collision check in the 
sub-three-dimensional virtual space, i.e., inner and 
outer checks between the boundary and a target point, 
realizes a great simplification (high speed processing) 
of the calculation of collision check. 

Claims 

1. A transmitter-receiver of three-dimensional skele- 
ton structure motions in which motion data of a 
skeleton structure in three-dimensional computer 
graphics (CG) is transmitted from a transmitting 
end to a receiving end and, based on the transmit- 
ted skeleton structure motion data, to create anima- 
tion at the receiving end, the transmitter-receiver 
comprising: 

(1) transmitting means for deciding either of 
transmitting formats: (a) the motion data of the 
skeleton structure is added to an initial informa- 
tion and then transmitted as time series data; 
and (b) the motion data of the skeleton struc- 
ture is disassembled into element data charac- 
terizing the motions in three-dimensional 
virtual space and then transmitted as data in 
which the disassembled element data is 
accompanied by connection methods thereto, 
and then transmitting the initial information to 
which the motion data of the skeleton structure 
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is added based on the decided transmission 
format, as CG animation data, 

the initial information including hierarchy 
data for defining hierarchical relationship of the 
skeleton structure, the initial state of the hierar- 5 
chy data, constraint of the joints of skeletons, 
shape data to be attached to the skeletons, and 
data relative to the attachment to the skeleton 
structure; 

(2) transferring means for transferring the CG 10 
animation data from the transmitting end com- 
puter to the receiving end computer, using a 
transmitting program on the transmitting end 
computer and a receiving program on the 
receiving end computer; and 15 

(3) receiving means in which the CG animation 
data from the transferring means is received, 
the transmitting format of the received CG ani- 
mation data is discriminated and, for the format 
(a), the initial information and the time series 20 
data is interpreted to decide the posture of the 
skeleton structure according to kinematics and, 

for the format (b), the initial information and the 
data in which the disassembled element data is 
accompanied by the connection methods 25 
thereto is interpreted to decide the posture of 
the skeleton structure according to kinematics. 

A transmitter-receiver of three-dimensional skele- 
ton structure motions in which motion data of a 30 
skeleton structure in three-dimensional computer 
graphics (CG) is transmitted from a transmitting 
end to a receiving end and. based on the transmit- 
ted skeleton structure motion data, to create anima- 
tion at the receiving end, the transmitter-receiver 35 
comprising: 

(1) transmitting means for deciding either of 
transmitting formats: (a) the motion data of the 
skeleton structure is added to an initial informa- 40 
tion and then transmitted as time series data; 
and (b) the motion data of the skeleton struc- 
ture is disassembled into element data charac- 
terizing the motions in three-dimensional 
virtual space and then transmitted as data in 45 
which the disassembled element data is 
accompanied by connection methods thereto, 
and then transmitting the initial information to 
which the motion data of the skeleton structure 
is added based on the decided transmission so 
format, as CG animation data, 

the initial information including hierarchy 
data for defining hierarchical relationship of the 
skeleton structure, the initial state of the hierar- 
chy data, constraint of the joints of skeletons, 55 
shape data to be attached to the skeletons, 
data relative to the attachment to the skeleton 
structure, a motion picture data stream for a 
motion picture mapping to a part of the shape 



data, and a mapping method, 

(2) transferring means for transferring the CG 
animation data from the transmitting end com- 
puter to the receiving end computer, using a 
transmitting program on the transmitting end 
computer and a receiving program on the 
receiving end computer; and 

(3) receiving means in which the CG animation 
data from the transferring means is received, 
the transmitting format of the received CG ani- 
mation data is discriminated and, for the format 
(a), the initial information and the time series 
data is interpreted to decide the posture of the 
skeleton structure according to kinematics and, 
for the format (b), the initial information and the 
data in which the disassembled element data is 
accompanied by the connection methods 
thereto is interpreted to decide the posture of 
the skeleton structure according to kinematics. 

3. A transmitter-receiver of three-dimensional skele- 
ton structure motions according to claim 1 or 2, 

the transmitting means including: 

(i) means for defining the skeleton structure 
and then transmitting the defined skeleton 
structure data as initial information; and 

(ii) means in which based on a position of a 
predecided part motions of the skeleton struc- 
ture in three-dimensional virtual space, the 
motion data is disassembled into representa- 
tive element data, to which data a connection 
method thereof is then added, followed by 
transmitting; and 

the receiving means including: 

(iii) means for restoring the transferred skeleton 
structure data as initial information; 

(iv) means for assigning shape data that is 
attached to the restored skeleton structure data 
as an initial state, to the skeleton structure; and 

(v) means for deciding the posture of the skele- 
ton structure based on the transferred element 
data and the transferred connection method. 

4. A transmitter-receiver of three-dimensional skele- 
ton structure motions according to claim 1 or 2, 

the transmitting means including: 

(i) means for transmitting the skeleton structure 
and the motion information of the skeleton 
structure; and 

(ii) means for compressing moving picture 
image data stream to be attached to a part of 
the skeleton structure, adding a method of 

, altering the moving picture image depending 
on the skeleton structure motions, to the com- 
pressed moving picture image data stream, fol- 
lowed by transmitting; and 

the receiving means comprising: 
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(ill) means for restoring the transferred skeleton 
structure and the motion information of the 
skeleton structure; and 

(iv) means for restoring the transferred moving 
picture image data stream and deciding the s 
posture of the skeleton structure by using the 
transferred method of altering moving picture 
image. 

A transmitter-receiver of three-dimensional skele- 10 
ton structure motions according to claim 1 or 2, 
the transmitting means including: 

(i) means for setting a local coordinate system 

to a primary position of a CG character as a is 
transmitting object; and 

(ii) means for estimating a three-dimensional 
virtual space covering a moving range of the 
character to which the local coordinate system 
has set; dividing the three-dimensional virtual 20 
space into sub-three-dimensional virtual 
spaces similar to the three-dimensional virtual 
space; hierarchically dividing the sub-three- 
dimensional virtual space; and displaying the 
position of a target portion of the skeleton 25 
structure of the character in the three-dimen- 
sional virtual space, based on the dimension 
and dividing size of the sub-three-dimensional 
virtual spaces, rotation matrix in the local coor- 
dinate system in response to the movement of 30 
the character, and information relative to the 
positions of the hierarchized sub-three-dimen- 
sional virtual spaces, to decide element data 
relative to the motion data of the skeleton struc- 
ture in the three-dimensional virtual space; and 35 

the receiving means including means for 
estimating the transferred three-dimensional 
virtual space, dividing the three-dimensional 
virtual space into sub-three-dimensional virtual 
space similar to the three-dimensional virtual 40 
space, hierarchically dividing the sub-three- 
dimensional virtual space, and restoring the 
position of the target portion in the three- 
dimensional virtual space, based on the dimen- 
sion and dividing size of the sub-three-dimen- 45 
sional virtual space, the rotation matrix in the 
local coordinate system in response to the 
movement of the character, and information rel- 
ative to the positions of the hierarchized sub- 
three-dimensional virtual spaces, to decide the so 
posture of the skeleton structure based on the 
element data relative to the motion data of the 
transferred skeleton structure in the three- 
dimensional virtual space. 

55 

A transmitter-receiver of three-dimensional skele- 
ton structure motions according to claim 1 or 2, 
the transmitting means including: 




(i) means for setting a local coordinate system 
to a primary position of a CG character as a 
transmitting object; 

(ii) means for estimating a three-dimensional 
virtual space covering a moving range of the 
character to which the local coordinate system 
has set; dividing the three-dimensional virtual 
space into sub-three-dimensional virtual 
spaces similar to the three-dimensional virtual 
space; hierarchically dividing the sub-three- 
dimensional virtual space; and displaying the 
position of a target portion of the skeleton 
structure of the character in the three-dimen- 
sional virtual space, based on the dimension 
and dividing size of the sub-three-dimensional 
virtual spaces, rotation matrix in the local coor- 
dinate system in response to the movement of 
the character, and information relative to the 
positions of the hierarchized sub-three-dimen- 
sional virtual spaces; and 

(iii) means for adding interpolation information 
for spatially interpolating blocks being isolated 
from each other, to animation data of the CG 
character under the conditions that target por- 
tions of the skeleton structure of the character 
are isolated from each other, to decide element 
data relative to the motion data of the skeleton 
structure in the three-dimensional virtual 
space; and 

the receiving means including: 

(iv) means for estimating the transferred three- 
dimensional virtual space, dividing the three- 
dimensional virtual space into sub-three- 
dimensional virtual space similar to the three- 
dimensional virtual space, hierarchically divid- 
ing the sub-three-dimensional virtual space, 
and restoring the position of the target portion 
in the three-dimensional virtual space, based 
on the dimension and dividing size of the sub- 
three-dimensional virtual space, the rotation 
matrix in the local coordinate system in 
response to the movement of the character, 
and information relative to the positions of the 
hierarchized sub-three-dimensional virtual 
spaces; and 

(v) means for restoring the continuous postures 
of the skeleton structure of the character by 
spatially interpolating blocks being isolated 
from each other based on the transferred inter- 
polation information under the conditions that 
the target portions are isolated, to decide the 
posture of the skeleton structure based on the 
element data relative to the transferred motion 
data. 

7. A transmitter-receiver of three-dimensional skele- 
ton structure motions according to claim 1 or 2, 
the transmitting means including: 
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(i) means for setting a local coordinate system 
to a primary position of a CG character as a 
transmitting object; 

(ii) means for estimating a three-dimensional 
virtual space covering a moving range of the s 
character, dividing the three-dimensional vir- 
tual space into sub-three-dimensional virtual 
spaces similar to the three-dimensional virtual 
space, hierarchically dividing the sub-three- 
dimensional virtual spaces, and displaying the 10 
positions of target portions of the skeleton 
structure of the character in the three-dimen- 
sional virtual space, based on the dimension 
and dividing size of the sub-three-dimensional 
virtual space, movement with rotation matrix in 15 
the local coordinate system in response to the 
movement of the CG character, and informa- 
tion relative to the position of the hierarchized 
sub-three-dimensional virtual spaces; and 

(iii) means for adding three-dimensional angle 20 
information of an arbitrarily designated part in 

the skeleton structure of the CG character to 
the CG animation data, to decide element data 
with respect to the motion data of the skeleton 
structure in the three-dimensional virtual 25 
space; and 

the receiving means including: 

(iv) means for estimating the transferred three- 
dimensional virtual space, dividing the three- 
dimensional virtual space into sub-three- 30 
dimensional virtual space similar to the three- 
dimensional virtual space, hierarchically divid- 
ing the sub-three-dimensional virtual space, 
and restoring the position of the target portion 

in the three-dimensional virtual space, based 35 
on the dimension and dividing size of the sub- 
three-dimensional virtual space, the rotation 
matrix in the local coordinate system in 
response to the movement of the character, 
and information relative to the positions of the 40 
hierarchized sub-three-dimensional virtual 
spaces; and 

(v) means for restoring the posture and shape 
of the skeleton structure of the character based 

on the three-dimensional angle information of 45 
the arbitrarily designated part of the skeleton 
structure, to decide the posture of the skeleton 
structure based on the element data relative to 
the transferred motion data. 

50 

A transmitter-receiver of three-dimensional skele- 
ton structure motions according to claim 1 or 2, 

the receiving means including means for 
estimating a three-dimensional virtual space cover- 
ing a moving range of the character, dividing the 55 
three-dimensional virtual space into sub-three- 
dimensional virtual spaces similar to the three- 
dimensional virtual space, hierarchically dividing 
the sub-three-dimensional virtual spaces, and dis- 



playing the positions of target portions of the skele- 
ton structure of the character in the three- 
dimensional virtual space, based on the dimension 
and dividing size of the sub-three-dimensional vir- 
tual space, movement with rotation matrix in the 
local coordinate system in response to the move- 
ment of the CG character, and information relative 
to the position of the hierarchized sub-three-dimen- 
sional virtual spaces, to detect collision of the 
motion of the transferred skeleton structure in 
three-dimensional virtual space. 

9. A transmitter-receiver of three-dimensional skele- 
ton structure motions according to claim 1 or 2, 

the transmitting means including: 

(i) means for designating the position of a CG 
character as a transmitting object in three- 
dimensional virtual space, based on either of 
information relative to positions: (a) a three- 
dimensional virtual space covering a moving 
range of the character; and (b) sub-three- 
dimensional virtual spaces obtained by dividing 
the three-dimensional virtual space; and 

(ii) means for altering the position of the char- 
acter in the three-dimensional virtual space by 
adding information relative to the position of a 
sub-three-dimensional virtual space adjacent 
to another sub-three-dimensional virtual 
space, under the conditions that position of the 
character in the three-dimensional virtual 
space is altered, to set the moving points of the 
skeleton structure to be transmitted in the 
three-dimensional virtual space; and 

the receiving means including: 

(iii) means for deciding the position of the char- 
acter as a receiving object in the three-dimen- 
sional virtual space, based on either of the 
transferred information relative to positions; 
and 

(iv) means for altering the position of the char- 
acter in the three-dimensional virtual space 
based on the transferred information relative to 
the positions adjacent to another sub-three- 
dimensional virtual space, under the conditions 
that the position of the character was altered at 
the transmitting means side, to set the moving 
points of the transferred skeleton structure in 
three-dimensional virtual space. 

10. A method of transmitting motion data of a skeleton 
structure in three-dimensional computer graphics 
(CG) from a transmitting end to a receiving end, to 
create animation at the receiving end, based on the 
transmitted skeleton structure motion data, the 
method comprising: 

(1) transmitting step for deciding either of trans- 
mitting formats: (a) the motion data of the skel- 
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eton structure is added to an initial information 
and then transmitted as time series data; and 
(b) the motion data of the skeleton structure is 
disassembled into element data characterizing 
the motions in three-dimensional virtual space 5 
and then transmitted as data in which the dis- 
assembled element data is accompanied by 
connection methods thereto, and then transmit- 
ting the initial information to which the motion 
data of the skeleton structure is added based w 
on the decided transmission format, as CG ani- 
mation data, 

the initial information including hierarchy 
data for defining hierarchical relationship of the 
skeleton structure, the initial state of the hierar- 15 
chy data, constraint of the joints of skeletons, 
shape data to be attached to the skeletons, and 
data relative to the attachment to the skeleton 
structure; 

(2) transferring step for transferring the CG ani- 20 
mation data from the transmitting end compu- 
ter to the receiving end computer, using a 
transmitting program on the transmitting end 
computer and a receiving program on the 
receiving end computer ; and 25 

(3) receiving step in which the CG animation 
data from the transferring means is received, 
the transmitting format of the received CG ani- 
mation data is discriminated and, for the format 

(a) , the initial information and the time series 30 
data is interpreted to decide the posture of the 
skeleton structure according to kinematics and, 

for the format (b), the initial information and the 
data in which the disassembled element data is 
accompanied by the connection methods 35 
thereto is interpreted to decide the posture of 
the skeleton structure according to kinematics. 

A method of transmitting motion data of a skeleton 
structure in three-dimensional computer graphics 40 
(CG) from a transmitting end to a receiving end 
and, based on the transmitted skeleton structure 
motion data, to create animation at the receiving 
end, the transmitting method comprising: 

45 

(1) transmitting step for deciding either of trans- 
mitting formats: (a) the motion data of the skel- 
eton structure is added to an initial information 
and then transmitted as time series data; and 

(b) the motion data of the skeleton structure is so 
disassembled into element data characterizing 
the motions in three-dimensional virtual space 
and then transmitted as data in which the dis- 
assembled element data is accompanied by 
connection methods thereto, and then transmit- 55 
ting the initial information to which the motion 
data of the skeleton structure is added based 

on the decided transmission format, as CG ani- 
mation data, 




the initial information including hierarchy 
data for defining hierarchical relationship of the 
skeleton structure, the initial state of the hierar- 
chy data, constraint of the joints of skeletons, 
shape data to be attached to the skeletons, and 
data relative to the attachment to the skeleton 
structure, a motion picture data stream for a 
motion picture mapping to part of the shape 
data, and mapping method; 

(2) transferring step for the CG animation data 
from the transmitting end computer to the 
receiving end computer, using a transmitting 
program on the transmitting end computer and 
a receiving program on the receiving end com- 
puter; and 

(3) receiving step in which the CG animation 
data from the transferring means is received, 
the transmitting format of the received CG ani- 
mation data is discriminated and, for the format 
(a), the initial information and the time series 
data is interpreted to decide the posture of the 
skeleton structure according to kinematics and, 
for the format (b), the initial information and the 
data in which the disassembled element data is 
accompanied by the connection methods 
thereto is interpreted to decide the posture of 
the skeleton structure according to kinematics. 

12. The method of transmitting/receiving threendimen- 
sional skeleton structure motions according to 
claim 10 or 11, 

the transmitting step including: 

(i) step of defining the skeleton structure and 
then transmitting the defined skeleton structure 
data as initial information; and 

(ii) step in which based on a position of a pre- 
decided part motions of the skeleton structure 
in three-dimensional virtual space, disassem- 
bling the motion data into representative ele- 
ment data, to which data a connection method 
thereof is then added, followed by transmitting; 
and 

the receiving step including: 

(iii) step of restoring the transferred skeleton 
structure data as initial information; 

(iv) step of assigning shape data that is 
attached to the restored skeleton structure data 
as an initial state, to the skeleton structure; and 

(v) step of deciding the posture of the skeleton 
structure based on the transferred element 
data and the transferred connection method. 

1 3. The method of transmitting/receiving three-dimen- 
sionaj skeleton structure motions according to 
claim 10 or 11, 

the transmitting step including the steps of: 

(i) transmitting the skeleton structure and the 
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motion information of the skeleton structure; 
and 

(ii) compressing moving picture image data 
stream to be attached to a part of the skeleton 
structure, adding a method of altering the mov- s 
ing picture image depending on the skeleton 
structure motions, to the compressed moving 
picture image data stream, followed by trans- 
mitting; and 

the receiving means including the steps 10 

of: 

(iii) restoring the transferred skeleton structure 
and the motion information of the skeleton 
structure; and 

(iv) restoring the transferred moving picture 15 
image data stream and deciding the posture of 
the skeleton structure by using the transferred 
method of altering moving picture image. 

14. The method of transmitting/receiving three-dimen- 20 
sional skeleton structure motions according to 
claim 10 or 11, 

the transmitting step including the steps of: 

(i) setting a local coordinate system to a pri- 25 
mary position of a CG character as a transmit- 
ting object; and 

(ii) estimating a three-dimensional virtual 
space covering a moving range of the charac- 
ter to which the local coordinate system has 30 
set; dividing the three-dimensional virtual 
space into sub-three-dimensional virtual 
spaces similar to the three-dimensional virtual 
space; hierarchically dividing the sub-three- 
dimensional virtual space; and displaying the 35 
position of a target portion of the skeleton 
structure of the character in the three-dimen- 
sional virtual space, based on the dimension 
and dividing size of the sub-three-dimensional 
virtual spaces, rotation matrix in the local coor- 40 
dinate system in response to the movement of 

the character, and information relative to the 
positions of the hierarchized sub-three-dimen- 
sional virtual spaces, to decide element data 
relative to the motion data of the skeleton struc- 45 
ture in the three-dimensional virtual space; and 
the receiving step including the step of 
estimating the transferred three-dimensional 
virtual space, dividing the three-dimensional 
virtual space into sub-three-dimensional virtual so 
space similar to the three-dimensional virtual 
space, hierarchically dividing the sub-three- 
dimensional virtual space, and restoring the 
position of the target portion in the three- 
dimensional virtual space, based on the dimen- 55 
sion and dividing size of the sub-three-dimen- 
sional virtual space, the rotation matrix in the 
local coordinate system in response to the 
movement of the character, and information rel- 
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ative to the positions of the hierarchized sub- 
three-dimensional virtual spaces, to decide the 
posture of the skeleton structure based on the 
element data relative to the rrjotion data of the 
transferred skeleton structure in the three- 
dimensional virtual space. 

15. The method of transmitting/receiving skeleton 
structure motions according to claim 10 or 1 1 , 

the transmitting step including the steps of: 

(i) setting a local coordinate system to a pri- 
mary position of a CG character as a transmit- 
ting object; and 

(ii) estimating a three-dimensional virtual 
space covering a moving range of the charac- 
ter to which the local coordinate system has 
set; dividing the three-dimensional virtual 
space into sub-three-dimensional virtual 
spaces similar to the three-dimensional virtual 
space; hierarchically dividing the sub-three- 
dimensional virtual space; and displaying the 
position of a target portion of the skeleton 
structure of the character in the three-dimen- 
sional virtual space, based on the dimension 
and dividing size of the sub-three-dimensional 
virtual spaces, rotation matrix in the local coor- 
dinate system in response to the movement of 
the character, and information relative to the 
positions of the hierarchized sub-three-dimen- 
sional virtual spaces, to decide element data 
relative to the motion data of the skeleton struc- 
ture in the three-dimensional virtual space; and 

(iii) adding interpolation information for spatially 
interpolating blocks being isolated from each 
other, to animation data of the CG character 
under the conditions that target portions of the 
skeleton structure of the character are isolated 
from each other 

the receiving step including the steps of: 

(iv) estimating the transferred three-dimen- 
sional virtual space, dividing the three-dimen- 
sional virtual space into sub-three-dimensional 
virtual space similar to the three-dimensional 
virtual space, hierarchically dividing the sub- 
three-dimensional virtual space, and restoring 
the position of the target portion in the three- 
dimensional virtual space, based on the dimen- 
sion and dividing size of the sub-three-dimen- 
sional virtual space, the rotation matrix in the 
local coordinate system in response to the 
movement of the character, and information rel- 
ative to the positions of the hierarchized sub- 
three-dimensional virtual spaces, to decide the 

, posture of the skeleton structure based on the 
element data relative to the motion data of the 
transferred skeleton structure in the three- 
dimensional virtual space; 

(v) estimating the transferred three-dimen- 
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sional virtual space, dividing the three-dimen- 
sional virtual space into sub-three-dimensional 
virtual space similar to the three-dimensional 
virtual space, hierarchically dividing the sub- 
three-dimensional virtual space, and restoring 5 
the position of the target portion in the three- 
dimensional virtual space, based on the dimen- 
sion and dividing size of the sub-three-dimen- 
sional virtual space, the rotation matrix in the 
Joca! coordinate system in response to the 10 
movement of the character, and information rel- 
ative to the positions of the hierarchized sub- 
three-dimensional virtual spaces, to decide the 
posture of the skeleton structure based on the 
element data relative to the motion data of the 75 
transferred skeleton structure in the three- 
dimensional virtual space; and 
(vi) restoring the continuous postures of the 
skeleton structure of the character by spatially 
interpolating blocks being isolated from each 20 
other based on the transferred interpolation 
information under the conditions that the target 
portions are isolated, to decide the posture of 
the skeleton structure based on the element 
data relative to the transferred motion data. 25 



(iv) estimating the transferred three-dimen- 
sional virtual space, dividing the three-dimen- 
sional virtual space into sub-three-dimensional 
virtual space similar to the three-dimensional 
virtual space, hierarchically dividing the sub- 
three-dimensional virtual space, and restoring 
the position of the target portion in the three- 
dimensional virtual space, based on the dimen- 
sion and dividing size of the sub-three-dimen- 
sional virtual space, the rotation matrix in the 
local coordinate system in response to the 
movement of the character, and information rel- 
ative to the positions of the hierarchized sub- 
three-dimensional virtual spaces, to decide the 
posture of the skeleton structure based on the 
element data relative to the motion data of the 
transferred skeleton structure in the three- 
dimensional virtual space; and 

(v) restoring the posture and shape of the skel- 
eton structure of the character based on the 
three-dimensional angle information of the 
arbitrarily designated part of the skeleton struc- 
ture, to decide the posture of the skeleton 
structure based on the element data relative to 
the transferred motion data. 



The method of transmitting/receiving skeleton 
structure motions according to claim 10 or 1 1 , 

the transmitting step including the steps of: 

30 

(i) setting a local coordinate system to a pri- 
mary position of a CG character as a transmit- 
ting object; 

(ii) estimating a three-dimensional virtual 
space covering a moving range of the charac- 35 
ter to which the local coordinate system has 
set; dividing the three-dimensional virtual 
space into sub-three-dimensional virtual 
spaces similar to the three-dimensional virtual 
space; hierarchically dividing the sub-three- 40 
dimensional virtual space; and displaying the 
position of a target portion of the skeleton 
structure of the character in the three-dimen- 
sional virtual space, based on the dimension 
and dividing size of the sub-three-dimensional 45 
virtual spaces, rotation matrix in the local coor- 
dinate system in response to the movement of 
the character, and information relative to the 
positions of the hierarchized sub-three-dimen- 
sional virtual spaces, to decide element data so 
relative to the motion data of the skeleton struc- 
ture in the three-dimensional virtual space; and 

(iii) adding three-dimensional angle information 
of an arbitrarily designated part in the skeleton 
structure of the CG character to the CG anima- 55 
tion data, to decide element data with respect 

to the motion data of the skeleton structure in 
the three-dimensional virtual space; 

the receiving step including the steps of: 



17. The method of transmitting/receiving skeleton 
structure motions according to claim 10 or 11, the 
receiving step including the step of estimating a 
three-dimensional virtual space covering a moving 
range of the character, dividing the three-dimen- 
sional virtual space into sub-three-dimensional vir- 
tual spaces similar to the three-dimensional virtual 
space, hierarchically dividing the sub-three-dimen- 
sional virtual spaces, and displaying the positions 
of target portions of the skeleton structure of the 
character in the three-dimensional virtual space, 
based on the dimension and dividing size of the 
sub-three-dimensional virtual space, movement 
with rotation matrix in the local coordinate system in 
response to the movement of the CG character, 
and information relative to the position of the hierar- 
chized sub-three-dimensional virtual spaces, to 
detect collision of the motion of the transferred skel- 
eton structure in three-dimensional virtual space. 

18. The method of transmitting/receiving skeleton 
structure motions according to claim 10 or 1 1 , 

the transmitting step including the steps of: 

(i) designating the position of a CG character 
as a transmitting object in three-dimensional 
virtual space, based on either of information 
relative to positions: (a) a three-dimensional 
virtual space covering a moving range of the 
character; and (b) sub-three-dimensional vir- 
tual spaces obtained by dividing the three- 
dimensional virtual space; and 

(ii) altering the position of the character in the 
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three-dimensional virtual space by adding 
Information relative to the position of a sub- 
three-dimensional virtual space adjacent to 
another sub-three-dimensional virtual space, 
under the conditions that position of the char- 5 
acter in the three-dimensional virtual space is 
altered, to set the moving points of the skeleton 
structure to be transmitted in the three-dimen- 
sional virtual space; and 

the receiving means including the steps w 

of: 

(iii) deciding the position of the character as a 
receiving object in the three-dimensional virtual 
space, based on either of the transferred infor- 
mation relative to positions; and 15 

(iv) altering the position of the character in the 
three-dimensional virtual space based on the 
transferred information relative to the positions 
adjacent to another sub-three-dimensional vir- 
tual space, under the conditions that the posi- 20 
tion of the character was altered at the 
transmitting means side, to set the moving 
points of the transferred skeleton structure in 
three-dimensional virtual space. 
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Fig.1 
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Fig.10 (a) 
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Fig.11 (a) 
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Fig.12 



STEP_1 set right hand tip right forward of face (set starting point) 

STEP_2 set right hand tip a little upper left (sub-three-dimensional virtual space 
X direction 2, Y direction 3) 

STEP_3 specify right hand finger shape (open a hand, no twist) 

STEP_4 set movement matrix of sub space 

STEP_5 set starting time 

set control point 

STEP - n set n 'ght hand tip left forward of waist (set end point) 

STEP_n+1 set right hand tip a little upper (sub-three-dimensional virtual space 
Zdirectionl) K 

STEP_n+2 set end time 
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Fig.13 



Right Hand = { Inverse, Translate, 

Start Motion => < sub block number >, < to >, 
Variation of hand shape, 

Trace Motionl => < sub block number >, < to + At >, 
Trace Motion2 => < sub block number >, < to + At >, 

End Motion < sub block number >, < t1 >, 
Variation of hand shape, 
Interpolation, < Spline >, 

} 

Left Hand = { Inverse, Translate, 

Start Motion => < sub block number >, < to >, 
Variation of hand shape, 

Trace Motionl => < sub block number >, < to + At >, 

End Motion => < sub block number >, < t1 >, 
Variation of hand shape, 
Interpolation, < Spline >, 

} 

Face Head = { Inverse, Translate, 

Start Motion => < sub block number >, < to >, 
Variation of face expression, 

Trace Motionl => < sub block number >, < tO + At >, 

End Motion => < sub block number >, < t1 >, 
Variation of face expression, 
Interpolation, < Spline >, 

} 
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(54) Transmitter-receiver of three-dimensional skeleton structure motions and method thereof 



(57) A transmitter-receiver of three-dimensional 
skeleton structure motions in which motion data of a 
skeleton structure in three-dimensional computer 
graphics (CG) is transmitted from a transmitting end to 
a receiving end and, based on the transmitted skeleton 
structure motion data, to create animation at the receiv- 
ing end, the transmitter-receiver comprises (1) transmit- 
ting means for deciding either of transmitting formats: 
(a) the motion data of the skeleton structure is added to 
an initial information and then transmitted as time series 
data; and (b) the motion data of the skeleton structure is 
disassembled into element data characterizing the 
motions in three-dimensional virtual space and then 
transmitted as data in which the disassembled element 
data is accompanied by connection methods thereto, 
and then transmitting the initial information to which the 
motion data of the skeleton structure is added based on 
the decided transmission format, as CG animation data, 
the initial information including hierarchy data for defin- 
ing hierarchical relationship of the skeleton structure, 
the initial state of the hierarchy data, constraint of the 
joints of skeletons, shape data to be attached to the 
skeletons, and data relative to the attachment to the 
skeleton structure; (2) transferring means for transfer- 
ring the CC animation data from the transmitting end. 
computer to the receiving end computer, using a trans- 
mitting program on the transmitting end computer and a 
receiving program on the receiving end computer; and 
(3) receiving means in which the CG animation data 
from the transferring means is received, the transmitting 



format of the received CG animation data is discrimi- 
nated and. for the format (a), the initial information and 
the time series data is interpreted to decide the posture 
of the skeleton structure according to kinematics and, 
for the format (b), the initial information and the data in 
which the disassembled element data is accompanied 
by the connection methods thereto is interpreted to 
decide the posture of the skeleton structure according 
to kinematics. 
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